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Abstract 

Probabilistic algorithms are applied to prove theorems about the hnite general linear and 
unitary groups which are typically proved by techniques such as character theory and Moebius 
inversion. Among the theorems studied are Steinberg's count of unipotent elements, Rudvalis 
and Shindoda's work on the fixed space of a random matrix, and Lusztig's work on counting 
nilpotent matrices of a given rank. 

1 Introduction and Background 

In thesis work done under the guidance of Persi Diaconis, Fulman |jl| defined and studied measures 
M(-„ q) on the set of all partitions of all integers. The definition uses the following standard notation 
from pages 3-5 of Macdonald [11]. Recall that A is said to be a partition of n = [A[ if Ai > A2 > 
• • • > and J2i ^i = "i^- Refer to the Aj as the parts of A. Let mi{\) be the number of parts of A 
equal to i. Then for q> 1 and < u < 1 the following formula defines a measure: 
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For < u < 1 and q a prime power, the measures M(u,(j) have a group theoretic description. For 
this recall (for instance from Chapter 6 of Herstein ||^) that the conjugacy classes of GL{n,q) are 
parameterized by rational canonical form. This form corresponds to the following combinatorial 
data. To each monic non-constant irreducible polynomial (j) over Fg, associate a partition (perhaps 
the trivial partition) A,^ of some non-negative integer |A<^|. Let m^ denote the degree of (p. The 
only restrictions necessary for this data to represent a conjugacy class are: 

L !A,| = 

2- E,/, |A<^|m^ = n 

To be explicit, and for use in Section ^, a representative of the conjugacy class corresponding 
to the data A(A may be given as follows. Define the companion matrix C(</>) of a polynomial 
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Let (/>!, • • • , i;^fc be the polynomials such that \X(f,. \ > 0. Denote the parts of A^ 
. Then a matrix corresponding to the above conjugacy class data is: 
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where i?,- is the matrix: 
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Now consider the following procedure for putting a measure on the set of all partitions of 
all integers. Fix u such that < m < 1. Pick a non- negative integer such that the chance of 
choosing n is equal to (1 — u)n". Then pick a uniformly in GL(n, q) and take A to be the paritition 
corresponding to the polynomial z — 1 in the rational canonical form of a (if n = take A to be the 
trivial partition). Fulman |^] proves that the random partition so defined obeys -^(^,5) measure. 

The measures Af(u,g) have further remarkable properties. To state them, we use the standard 
notation that A^ = mi{X) + mj_|_i(A) + • • •. Then the following three equations hold (for the third 
equation assume that k > 2) 
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These equations alone, independent of their group-theoretic motivation, are strong evidence that 
the measures M(„ g\ are worthy of study. The first two equations will be proved probabilistically 
and interpreted group theoretically in this paper. The third equation is related to the Rogers- 
Ramanujan identities and has group theoretic meaning. For more on this third equation, which 
seems to be the first appearance of the Rogers- Ramanuj an identities in finite group theory, see the 
paper by Fulman Q. 

The measures Mi^^q\ are intimately related to symmetric function theory, which is the topic 
of the companion paper by Fulman |y]. That paper exploits the link with symmetric functions to 
develop a probabilistic algorithm, called the "Young Tableau Algorithm", for growing partitions 
according to the measure M(^^q\. This and related algorithms are described in Section |2| of this 
paper and will be key tools of this paper. 

Section |3| applies the tools of Section § to three settings. First, Steinberg's count of unipotent 
elements is proved for GL{n,q) and U{n,q). Second, a deeper understanding is given to work of 
Rudvalis and Shinoda [|l2| on the fixed space of a random element of GL{n,q) or U{n,q). Third, 



Lusztig's [10 1 results on nilpotent matrices of a given rank are derived probabilistically. 

In principle, the algorithms of Section || should be useful for analyzing any conjugacy class 
function of GL{n, q) or U{n, q). The results of this paper only scratch the surface. 



2 Probabilistic Algorithms 

Fulman ||l[ develops probabilistic algorithms for growing partitions according to the measures M(^^q\. 
We first describe the "Young Tableau Algorithm". To state it, recall that one defines the diagram 
associated to A as the set of points {i,j) € Z'^ such that 1 < j < Aj. We follow Macdonald's 
convention that the row index i increases as one goes downward and the column index j increases 
as one goes across. So the diagram of the partition (432) is: 



by the natural numbers, such that coin i has probability ^ of heads and probability 1 — t- 



Now we state the Young Tableau Algorithm. Fulman [Q] proves that for < u < 1 and g > 1, 
the algorithm always halts and that the resulting partition obeys Mr^^q) measure. 

The Young Tableau Algorithm 

Step Start with A^ = 1 and A the empty partition. Also start with a collection of coins indexed 
by the : 
of tails. 

Step 1 Flip coin N. 

Step 2a If coin N comes up tails, leave A unchanged, set A^ = A^ + 1 and go to Step 1. 

Step 2b If coin N comes up heads, choose an integer S* > according to the following rule. Set 

5 = 1 with probability ^— n^^— • Set S = s > 1 with probability ^ -ttzi • Then 

increase the size of column s of A by 1 and go to Step 1. 

The following remarks may be helpful. 

1. Recall that a standard Young tableau T of size n is a partition of n with each dot replaced by 
one of {1, • • • , n} such that each of {1, ■ • • , n} appears exactly once and the numbers increase 
in each row and column of T. For instance, 

13 5 6 

2 4 7 
8 9 

is a standard Young tableau. The Young Tableau Algorithm is so named because numbering 
the dots in the order in which they are created gives a standard Young tableau. 

2. As an example of the Young Tableau Algorithm, suppose we are at Step 1 with A equal to 
the following partition: 



Suppose also that A^ = 4 and that coin 4 had ah'eady come up heads once, at which time we 
added to column 1, giving A. Now we flip coin 4 again and get heads, going to Step 2b. We 
add to column 1 with probability ^4~ , to column 2 with probability \5f > to column 3 with 

3 2 4 3 

probability '^4~'^, , to column 4 with probability 0, and to column 5 with probability '' i^, . 
We then return to Step 1. 

There is a second way to decompose the measures M^^^^^gy This uses the so-called Young lattice, 
which is important in combinatorics and representation theory. The elements of this lattice are all 
partitions of all numbers. An edge is drawn between partitions A and A if A is obtained from A by 
adding one dot. 



Theorem 1 (Fulman Jj/J Put weights ?71a,a on the Young lattice according to the rules: 
1- iT^X A = -^ — jr—i if A is obtained from A by adding a box to column 1 

q l{q I -1) 

/ — a' 
2. m\ A = ^-^ — ''-rA if A is obtained from A by adding a box to column s > \ 

q^l-l 



Then the following formula holds: 
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where the sum is over all paths 7 from the empty partition to X, and the 7^ are the partitions 
along the path 7. 

Remarks 

1. Observe that a Young tableau T of shape A is equivalent to a path in the Young lattice from 
the empty partition to A. This equivalence is given by growing the partition A by adding 
boxes in the order 1, • • • , n in the positions determined by T. For instance the tableau: 

1 3 4 
2 

corresponds to the path: 



The proof of Theorem || relies on the result that the chance that the Young Tableau Algorithm 
outputs the standard tableau T is equal to: 

00 |Ahl 

111(1-77)] n-7.7... 

r=l ^ j=0 

where 7 is the path in the Young lattice which corresponds to the tableau T. 



2. Note that in Theorem |l| the total weight out of the empty partition is -^ and that the total 
weight out of any other partition A is: 
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Since the sum of the weights out of a partition A to a larger partition A is less than 1, the 
weights can also be viewed as transition probabilities, provided that one allows for halting. 

3. Fulman [|| gives a third way of building partitions according to the measure M(^,j). That 
algorithm is similar to the Young Tableau Algorithm, but works by adding "horizontal strips" . 
It would be interesting to find applications for this third algorithm as well. 

3 Applications 

This section uses the algorithms of Section ^ to obtain results about the general linear and unitary 
groups. The concept of a "cycle index" connects the measures M(„ g) with these groups. The cycle 
index of the general linear groups is due to Kung S and Stong 1 14 1 , though without the idea of 



measures on partitions. The cycle index for the unitary groups was found by Fulman ||l|. 

1. General Linear Group Cycle Index Let a be an element of GL{n,q) and (J) a monic, 
degree m^ irreducible polynomial with coefficients in Fq, the field of q elements. Let \(j,{a) 
be the partition corresponding to the (j) in the rational canonical form of a. Then, 

oo n 

(1 - «)[i + E \rT(„ a)\ ^ n H,Mc.)] = n (E X^,xM(u,r^){X)) 

2. Unitary Group Cycle Index The conjugacy classes of U{n,q) C GL{n,q'^) have a descrip- 
tion analogous to rational canonical form for GL(n, q). Given a polynomial (p with coefficients 
in Fq2 and non-vanishing constant term, define a polynomial (p by: 



where 4>'^ raises each coefficient of (p to the qth. power. Writing this out, a polynomial (p{z) 
^m^ _u n,„^^_;^2™'</.-i -\ \- aiz + ao with oq 7^ is sent to 4>{z) = z"^'i> + (|i)'?z"'0-i -\ 
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( — - — )'^z -\- ( — )''. Fulman ffl shows that all (p satisfying (p = (p have odd degree. 



Wall ||15[ proves that the conjugacy classes of the unitary group correspond to the following 
combinatorial data. As was the case with GL{n, q'^), an element a G U{n, q) associates to each 
monic, non-constant, irreducible polynomial (p over F^i a partition A^ of some non-negative 
integer lA^I by means of rational canonical form. The restrictions necessary for the data A^ 
to represent a conjugacy class are: 



(a) |A,| = 

(b) A^ = A^ 

(c) E</,|A0|?n^ = n 

This leads to the cycle index: 



CO r, 
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n (E ^</'.A^(n2™0,g2m^)(A)) 

It is elementary to see that M/_„ _g) is also a measure. The Young Tableau Algorithm can 
not be applied to pick from it, however, because some of the "probabilities" involved would 
be negative. Nevertheless, the description in terms of weights on the Young lattice (Theorem 
|l|) does extend by replacing u and q by their negatives. 

The following three elementary lemmas will be of use in the applications to follow. 
Lemma 1 

Proof: For all (p, perform the following substitutions in the cycle index of the general linear 
groups. If |A| > 0, set x^^a = 0. If |A| = 0, set x<^_a = 1. □ 



Lemma 2 
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Proof: Make the same substitutions as in Lemma |^, but for the unitary groups. □ 

Lemma H is elementary and is taken from page 280 of Hardy and Wright [B| . 
Lemma 3 For real a,y such that \a\ < 1, \y\ < 1, 

— 1 + ay- h a'^y^^^ — ^ \ 



Application 1: Counting unipotent elements 

The following theorem of Steinberg is normally proven using the Steinberg character, as on page 
156 of Humphreys ||8[. Recall that a G GL{n, q) is called unipotent if all of its eigenvalues are equal 
to one. 

Theorem 2 The number of unipotent elements in a finite group of Lie type G^ is the square of 
the order of a p-Sylow of G^ , where p is the prime used in the construction of G^ (in the case of 
the classical groups, p is the characteristic of Fg). 



The goal of this apphcation is to give a probabihstic proof of Steinberg's result for GL{n, q) 
and U{n,q). To this end, we obtain a generating function for the size of a partition A chosen from 
the measure M(„g). 

Theorem 3 

oo fl _ iL) 
A r=l ^ q"- ) 

Proof: Observe from the Young Tableau Algorithm that the size of the partition is equal to the 
total number of coins which come up heads. The r = i term of the product on the right hand 
side corresponds to the tosses of coin z, and these terms are multiplied because the coin tosses of 
different coins are independent. □ 

Corollary 1 The number of unipotent elements of GL{n,q) is g"("~^). 

Proof: Setting Xz-i^x = x''^' and x^^x = for 7^ z — 1 in the cycle index for GL{n, q) shows that 
the number of unipotent elements of GL{n, q) is 

1 "-^ 771 J, 

|GL(n,g)|K."]— -(5:xl^lM(.,,)(A))( [] 11(1-^)) 
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The first equality comes from Theorem |3[ The second equality is Lemma ||, and the third 
equality is Lemma |^ with a = ux,y = -. □ 

A similar argument works for the unitary groups. It is well known that the order of U{n, q) is 
Q^^^ n?=i(9* ~ (~1)*) s-i^d its p-Sylows have size qy^) . 



n(n— 1) 



Corollary 2 The number of unipotent elements of U{n, q) is q' 

Proof: Setting Xz^i^x = x'^' and x^^a = for i?!) 7^ z — 1 in the cycle index for U{n, q) shows that 
the number of unipotent elements of U{n, q) is 
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The first equality comes from Theorem ^ with u and q replaced by their negatives (this substi- 
tution is valid, even though the probabilistic proof of Theorem y breaks down for this case). The 
second equality is Lemma ^. The third equality uses Lemma |3| with a = —ux,y = —-. □ 

Remarks 

1. The proof technique of Corollaries |l| and can be used to give formulas for the number of 
elements of GL{n,q) and U{n,q) with a given characteristic polynomial. See Fulman [Q| for 
details. 

2. At least for GL{n,q), there should be a proof of Steinberg's count of unipotents which is 
bijective (i.e. which maps a pair of elements in a p-Sylow to a unipotent element). 

Application 2: Work of Rudvalis and Shinoda 

Rudvalis and Shinoda [^] studied the distribution of fixed vectors for the classical groups over 
finite fields. Let G = G{n) be a classical group (i.e. one of GL,U,Sp, or O) acting on an n 
dimensional vector space V over a finite field Fq (in the unitary case F„2) in its natural way. Let 
PG,nik,q) be the chance that an element of G fixes a k dimensional subspace and let PG,oo{k,q) 
be the n — > oo limit of PG,n{k, q)- Rudvalis and Shinoda [^] obtained the following results for the 
general linear and unitary cases. 



1 R-r (h .71 - ^ y""~^ (-i)'g(^) 

i- ^GL,n{K,q) - \GL(k,q)\ 2^i=0 qki\GL{i,q] 



2. PGL,oo{k,q) = [Ur=ii^ - ^)] a_iffa_M2 

o p^^ (1, „N _ 1 ^n-k (-l)'(-g)( ^) 



\U{Kq)\ ^i=0 {-qY^\U{i,q)\ 
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4. Pu,o.{k,q) = [UZoi^ + i47)] n_V) (1-^ 



At first glance it is not even clear that PGL,oo{k, q) and Pu,ooik, q) define probability distributions 
in k, but as Rudvalis and Shinoda note, this follows from identities of Euler. Proofs of the above 
results of Rudvalis and Shinoda used Moebius version on the lattice of subspaces of a vector space 
and a detailed knowledge of geometry over finite fields. 

Theorem || of the previous section will lead to probabilistic proofs of the above four equations. In 
particular, a probabilistic interpretation will be given to the products in the formulas for Pgl, oo(^) l) 
and Pu,ooik, q). The first step is to connect the theorems of Rudvalis and Shinoda with the partitions 
in the rational canonical form of a. 

Lemma 4 The dimension of the fixed space of an element a of GL{n,q) is equal to Az_i(a)']^ (i.e. 
the number of parts of the partition corresponding to the polynomial z — 1 in the rational canonical 
form of a). 

Proof: It must be shown that the kernel of a — /, where / is the identity map, has dimension 
Xz-iiaYi. By the explicit description of the rational canonical form of a matrix in Section 11], it is 
enough to prove that the kernel of the linear map with matrix M = G{{z — 1)*) — / is 1 dimensional 
for all i (as in Section |l|, C((/)) is the companion matrix of a polynomial (p). 



Each of the first i — 1 rows of M sums to 0, and they are linearly independent. So it needs to be 
shown that the last row of M has sum 0. This follows from the fact that the coefficients of {z — 1)* 
sum to 0. □ 

To proceed further, we need some more notation. Let T be a standard Young tableau with k 
parts. Define numbers hi{T), • • • , h].{T) associated with T. Let hm{T) = T(^^x,i) ~ ^(m,i) ~ 1 for 
1 <m <k — 1 and let hk{T) = \T\ — T(^k,i)- So if A; = 3 and T is the tableau 

13 5 6 
2 4 7 
8 9 

then hi{T) = 2-1-1 = 0, /i2(r) = 8 - 2 - 1 = 5, and /i3(T) =9-8 = 1. View T as being 
created by the Young Tableau Algorithm. Then for 1 < m < k — 1, hm{T) is the number of dots 
added to T after it becomes a tableau with m parts and before it becomes a tableau with m + 1 
parts. hk{T) is the number of dots added to T after it becomes a tableau with k parts. The proof 
of Theorem ^ will show that if one conditions T chosen from the measure Af(„ g) on having k parts, 
then the random variables hi{T), • • • , hk{T) are independent geometries with parameters -,•••, -^. 
This will explain the factorization on the right-hand side of the formula in Theorem Q 

Theorem 4 



\^ Wat f\\— {'^^Y n-^i(l ~ ^ 



Proof: We sum over all Young tableaux T with k parts "xl-^l times the chance that the Tableau 
algorithm outputs T". The point is that one can easily compute the probability that the Tableau 
algorithm produces a tableau T with given values hi,- ■ ■ ,hk- 

Suppose that one takes a step up along the Young lattice from a partition with m parts. Theorem 
H implies that the weight for adding to column 1 is m( m+i_i) : and that the sum of the weights for 

adding to any other column is ^. Thus x' ' times the chance that the Tableau algorithm yields a 
tableau with given values hi,- ■ ■ ,hk is: 

oo t \k k 

Summing over all possible values of hm > gives: 

oo / N^. A; oo 

E .«M,„,„,A) ^ n(i-j)^^n[E(^)-i 

X:J2X[=k r=l ^ ' ^ ' ^^ I m=l /i,„=0 ^ 

oo / \fc fe 1 
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To deduce the The Rudvalis/Shinoda formulas for the general linear and unitary groups, two 
further easy lemmas will be used. 



Lemma 5 If f{l) < cx) and f has a Taylor series around 0, then 

/im„_.ooK]/^ = /(l) 
1 — u 

Proof: Write the Taylor expansion f{u) = Y.'^=q O'nu'^ ■ Then observe that [-"""] jz^ = J27=o'^i- ^ 
Lemma 6 (Goldman and Rota ^) 

OO OO / \7 
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The goal of our second application of the algorithms of Section can now be attained. 
Theorem 5 (Rudvalis and Shinoda jp^) 

1 P^r (k rA - 1 ^pn-fc (-l)'g*-^^ 

-'■ ^GL,n{K,q) - \GL(k,q)\ 2^i=0 qi=^GL{i,q)\ 

2. PGL,oo{k,q) = [UZia - ^)] n-i)S\_ip 

o n ^ (J, „\ _ 1 spn-k (-l)'(-g)(2) 

I Pu,oo{k^q) = [nr%(i + T^)]7rr^f^rr^) 

\ ^^ > ^ g2fc ' 

Proof: In the cycle index for the general linear groups, set Xz~\^\ = 1 if A has k parts and x^^\ = 
otherwise. By Lemma ^, Theorem ^ with x = 1, and Lemma ^ 

PGL,n{Kq) = K]t^ E ^mW 
^ ^ \:X[=k 

= \u ' 



{l-u)\GL{k,q)\ 

1 ..n-.i 1 >^ i-iyiuq-'^ 



\GL{k,qr h-utAq'-l)---{q-l) 



1 '^^ (-1)^ 



\GL{k,q)\ f^^{q^-l)...[q-l) 

For the second part of the theorem use Lemma g and Theorem |^ with x = 1, u = 1 to conclude 
that: 

PGL,oo{k,q) = limn-.oo[u'^]-r^— E ^(u,q)W 

^ ^ \:X[=k 
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nr=fc+l(l ~ ^) 



q' 



\GL{k,q)\ 

For the third statement, set x^^i^x = 1 if A has k parts and x^^a = otherwise in the cycle 
index of the unitary groups. As for the general linear groups, 

(-^)'nr=i(i 



, --,-., (_,)... 



(l-n)|GL(A:,-5)| 

1 r n-^i J_ V (-l)-(-n(-g)-^')' 
\U{k,q)\^ h-ui^({-qY-l)---{-q-l) 



4 = 



1 "^^ {-ir{-qp 



\U{k,q)\^^{-qr\U{i,q)\ 
For the fourth statement argue as for the general linear groups to conclude that: 

^ "" A:A;=fe 
Ilr=k+li^ + P^) 



1^(^,9)1 



n:=i(i + 7^)(i 



[11(1+ M ^^' 



.=1 (-9^ (1-^) •••(!- ^) 
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Remark The reason that the formulas for PGL,oo{k,q) and Pu,ooik,q) factor is because the 
random variables hi{T) defined from the Young Tableau Algorithm (see the comments preceding 
Theorem ^ are independent geometries. 

Rudvalis and Shinoda obtained, after many pages of labor, the following analogous formulas for 
the symplectic and orthogonal groups: 

oo -I ^ "^^ 

1 , X 2 



Psv,oo{k,q) = [X{YT^]-^ 



r=l 



'•\l-x)---{l-x'^) 



oo -. i^^— 



,^=1 l + x'-\l-x)---{l-x^)' 
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It would be marvellous if there are analogs of the Young Tableau Algorithm for the unipotent 
conjugacy classes of the symplectic and orthogonal groups. This should lead to a probabilistic 
interpretation of the products in the Rudvalis/Shinoda formulas. Chapters 5 and 6 of Fulman |l|] 
give some preliminary results in this direction. 

Application 3: Work of Lusztig on nilpotent matrices of a given rank 

This application uses Theorem ^ (which was proved probabilistically) to prove results of Lusztig 
|10|. The two theorems which follow were sufficiently nontrivial for Lusztig to devote a note toward 



them. We found them independently. 

Theorem 6 (Lustzig ^^) The number of rank n — k nilpotent n *n matrices is: 

\GL{n,q)\ (l-^)---(l-^) 

Proof: Adding the identity show that it suffices to count unipotent matrices in GL{n,q) with a k 
dimensional fixed space. In the cycle index for the general linear groups, set x^-i^x = x'"^' if A has 
k parts and x^p^x = otherwise. By Lemma § and Theorem §, the sought number is: 



. u\GL{k,q)\ll';^^[l-f] 






ux ^ 



\GL{k,qr' ' ^n'=i(l 

|GL(n,g)| 1 (1 - ^) • ' ' (1 - ^) 
\GL{k,q)\q^-^ (l_i)...(l_ 1 ) 



The first equality used Lemma |6| and the third equality used Lemma 0. D 

Theorem is the corresponding result for the unitary groups. Lusztig actually counted certain 
nilpotent matrices, but our statement is equivalent. This can be seen using the so-called "Cayley 
Transform" between unipotent and nilpotent matrices (page 177 of Humphreys [0]). 



Theorem 7 (Lustzig ^J^) The number of unipotent elements ofU{n,q) with a k dimensional fixed 
space is: 

\Uin,q)\ (l-(4F)---(l-piJ^) 
|f/(/^,'Z)k"-ni-(^)---(l-(Z^) 

Proof: Arguing as in Theorem y, the sought number is: 



\TTr \\u \m 1 {-ux)^ nj^i(l-p:^ 
\U{n,q)\[{ux)''] 



l-u\GL{k,q)\ll^^^^{l-p^^ 
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I^(^'g)l r^„.^^n-fc1 1 S^=o ((_g)»_i)...(_g_i) 
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